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The detection of neuronal communities is addressed with basis on two important concepts from 
neuroscience: facilitation of neuronal firing and nearly simultaneous beginning of activation of sets 
of neurons. More specifically, integrate-and-fire complex neuronal networks are activated at each of 
their nodes, and the dissemination of activation is monitored. As the activation received by each 
neuron accumulates, its firing gets facilitated. The time it takes for each neuron, other than the 
source, to receive the first non-zero input (beginning activation time) and the time for it to produce 
the first spike (beginning spiking time) are identified through simulations. It is shown, with respect 
to two synthetic and a real- world (C. elegans) neuronal complex networks, that the patterns of 
beginning activation times (and to a lesser extent also of the spiking times) tend to cluster into 
groups corresponding to communities of neurons in the original complex neuronal network. Such an 
effect is identified to be a direct consequence of the almost simultaneous activation between the nodes 
inside the same community in which the source of activation is placed, as well as of the respective 
trapping of activation implied by the integration of activiation prior to firing. Interestingly, the 
accumulation of activity and thresholds inside each neuron were found to be essential for constraining 
the initial activations within each respective community during the transient activation (no clear 
clusters were observed when using overall activation or spiking rates). In addition to its intrinsic 
value for neuroscience and structure-dynamics studies, these results confirm the importance of the 
consideration of transient dynamics in complex systems investigations. 

PACS numbers: 87.18.Sn, 05.40Fb, 89.70.Hj, 89. 75. He, 89.75.Kd 



'The brain is a wonderful organ. It starts working the 
moment you get up in the morning and does not stop 
until you get into the office. (R. Frost) 



I. INTRODUCTION 

Much has been investigated about neuronal systems 
from both the biological and exact sciences points of view 
(e.g. [l|). More recently, neuronal networks met complex 
networks (e.g. 0, 1 i, i, i, 0, B i, 113 ) ■ Such an inter- 
face is particularly promising, as it allows the emphasis 
of dynamical systems characterizing research in neuronal 
networks to be integrated with the structural approaches 
of complex networks research (e.g. [ll|, [l^, [3, 
The intersection of these two major areas, which lies 
at the heart of the structure and dynamics relation- 
ship (e.g. [H, [3), is henceforth called Complex Neu- 
ronal Networks research. However, despite the growing 
attention to this are, few works have considered simple 
neuronal models such as the integrate-and-fire. In addi- 
tion, rather few studies have addressed transient dynam- 
ics (e.g. [l^) or the accumulation of stimuli responsible 
for the facilitation of firing pj]. 

In a recent study [l7j . the transient dynamics of 
integrate-and-fire networks underlain by several types 
of connectivity was characterized with respect to a se- 
ries of dynamical properties, including the activation 
of nodes, spiking, and onset times for activation and 
spiking. As the activation received by each neuron 
was stored inside it as its state (facilitation [J), it be- 
came possible to investigate the activation and spiking 



separately. The neuronal dynamics was found to vary 
markedly with respect to the connectivity, with abrupt 
transitions of initiation of generalized spiking being ob- 
served for some complex networks models, as well as 
for the C. elegans network. The current work contin- 
ues such a investigation in order to investigate for pos- 
sible simultaneous neuronal activation as a consequence 
of concentrated interconnectivity between groups of neu- 
rons. The basic idea is that more intensely intercon- 
nected g rou p s of neurons, i.e. communities of nodes 

(e.g. [il E ill, 113, [11 H iS 111, [13, [H, p), 

would imply concentration of the accumulated activa- 
tion because of the thresholds, delaying the dissemination 
of the activation to other parts of the network. More 
specifically, external activation is fed into each of the 
N neurons, and the unfolding activation is monitored. 
The beginning activation time of each neuron i (except 
that used as source) is experimentally determined, corre- 
sponding to the time from the beginning of the external 
activation to the first arrival of non-zero stimuli at neu- 
ron i. Therefore, a pattern of iV — 1 beginning activation 
times are obtained for each place of stimulation. Be- 
cause of the high dimensionality of these patterns, the 
statistical method known as Principal Component Anal- 
ysis — PC A (e.g. [3) [13) is applied for dimensionality 
reduction (through optimal decorrelation), allowing the 
visualization of the distribution of patterns of beginning 
activation times. Interestingly, these patterns were found 
to be organized in well-defined clusters for two synthetic 
networks, allowing the immediate identification of the 
neuronal communities. Structure distributions, also con- 
taining clusters, was also observed for the C. elegans net- 
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work. Similar, though a httle less effective, results were 
obtained by considering the beginning spiking times. No 
clusterings are observed in case the activation of spiking 
patterns at specific times (or even averages) are taken 
into account. Such results corroborates the importance 
of transient dynamics in complex systems investigations. 

This article starts by presenting the basic concepts in 
complex networks, integrate-and-fire complex neuronal 
networks and the statistical method of Principal Compo- 
nent Analysis. The results, discussion and perspectives 
for future investigations are presented subsequently. 



II. BASIC CONCEPTS 

A directed, unweighted network T can be fully repre- 
sented in terms of its adjacency matrix K . Each edge 
extending from node i to node j implies K{j^ i) = 1. The 
absence of connection between nodes i and j is repre- 
sented as K{j,i) = 0. The out-degree of a node i, hence- 
forth expressed as k, corresponds to the number of out- 
going edges of that node. An analogue definition holds 
for the in-degree. The immediate neighbors of a node i 
are those nodes which can be reached from i through an 
outgoing edge. Two nodes are adjacent if they share an 
edge; two edges are adjacent if they share a node. A walk 
is a sequence of adjacent edges, with possible repetitions 
of nodes and edges. A path is a walk without repetition 
of nodes or edges. The length of a walk (or path) is equal 
to the number of the edges it contains. The shortest path 
length between two nodes is the length of the shortest 
path between them. 

An integrate-and-fire neuron involves two successive 
stages: (i) summation of the inputs Xi, i.e. S = X^i^i! 
and (ii) thresholding, i.e. a spike is produced whenever S 
is larger than a threshold T . In this work, each node rep- 
resents an integrate-and-fire neuron. The incoming acti- 
vation (from dendrites) is accumulated as its state until a 
spike occurs, in which case the accumulated activation is 
completely flushed out through the outgoing connections 
(axons). In order to ensure conservation of the total ac- 
tivation, ach outgoing axon conveys a fraction S/k{i) of 
the respective previously accumulated activation, where 
k{i) is the out-degree of neuron i. The activation and 
spiking of all neurons in the network can be represented 
through the respective activogram and spikegram, namely 
matrices storing the activation or occurrence of spikes for 
every node along all considered times. In this article, all 
neurons have the same threshold T = 1, and the external 
activation of the network is always performed by inject- 
ing activation of intensity 1 at each of the neurons. For 
each of these activations (with the source of activation 
placed at node w), the time one neuron i takes, from the 
beginning of the external initiation, to receive the first 
non-zero input is henceforth called its respective begin- 
ning activation time Ta{i,v). The time it takes for that 
neuron to produce the first spike is the beginning spiking 
time Ts{i, v). 



The dimensionality of the measurement space defined 
by the onset activation times for each node in a network 
involves N measurements (ssj (the beginning times). So, 
we have a total of N measurements for each of the N 
nodes, which is a high dimensional space involving sev- 
eral correlations between the times. The dimensionality 
of such measurements spaces can be convenient and op- 
timally reduced (decorrelation) by using the Principal 
Component Analysis (PCA) methodology (e.g. pu3.f30[). 
Let each of the N observations v = {1,2,..., A''}, charac- 
terized by the set of beginning times at each neuron z as a 
consequence of activation placed at node v, be organized 
as respective feature vectors , with respective elements 
fvii) = Ta{i,v), i £ {1, 2, . . . , iV}. Let the covariance 
matrix between each pair of measurements i and j be 
defined in terms of its elements 



C{^,J) ^ j^^Y^^m - ^Ji.){UJ) ~ (1) 

where is the average of fy{i) over the N observa- 
tions. The eigenvalues of C, sorted in decreasing order, 
are represented as A^, i = 1,2, ...,M, with respective 
eigenvectors Vi . The following matrix, obtained from the 
eigenvectors of the covariance matrix, defines the stochas- 
tic linear transformation known as the Karhunen-Loeve 
Transform [3, [s^l ■ 

" < — vi > " 



L < — v„i — > J 

where m = N . Because such a transformation concen- 
trates the variance of the observations along the first axes 
(the so-called principal axes), it is frequently possible to 
reduce the dimensionality of the measurements without 
losing much information (the variances along the other 
axes tend to be small as a consequence of correlations be- 
tween the original measurements) by considering in the 
above matrix only the m < N eigenvectors associated to 
the larges eigenvalues. The new measurements 5, with 
dimension m, can now be straightforwardly obtained as 

9 = Gf. (3) 



III. RESULTS AND DISCUSSION 

The potential of the neuronal community detection 
approach reported in this article is illustrated with re- 
spect to the three following directed networks: (a) a syn- 
thetic network {Netl ) containing 3 small communities 
(Figure [T|); (b) a medium-sized synthetic network {Net2) 
containing 4 communities (Figure[T]); and (c) the network 
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of C. elegans (NetCe) [23] ■ The two synthetic commu- 
nities were obtained by randomly assigning direct edges 
among each of the communities, extracting the connected 
component, and interconnecting the communities accord- 
ing to a fixed probabihty. Each of the three communities 
in Netl contains 5, 7 and 7 nodes, respectively. Each 
of the four communities in Net2 contains 20, 37, 22 and 
24 nodes. The largest strongly connected component in 
the C. elegans network, used in this work, contained 239 
nodes. 
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FIG. 1: A simple network (Netl) involving 3 communities 
with 5, 7 and 7 nodes considered in this work for illustrative 
purposes. 



Figure [3] shows the activograms and the spikegrams, 
as well as the respective beginning activation and begin- 
ning spiking times diagrams for activation placed at node 
3 (a), 9 (b) an 16 (c). It is clear from the respective be- 
ginning activation time diagram in Figure [31^ a) that the 
activation being received by node 3 implied in early and 
simultaneous conveyance of non-zero activation to the 
other nodes in the community to which node 3 belongs 
(i.e. the community including nodes 1 to 5). Observe 
that the beginning spiking times, shown in the respective 
diagram, are larger than the activation time, because the 
respective neuronal firing requires accumulation of the 
activation received by the dendrites of the neurons in 
that community. Similar nearly simultaneous activations 
of the other communities can be identified in Figure [3I^b) 
and (c). However, a less uniform initiation of activation 
in the this community is observed in Figure [3Jc). 

Figure[3]shows the distribution of the beginning activa- 
tion times after PCA projection onto a two-dimensional 



space defined by the principal variables peal and pea2. 
The three communities yielded well-defined respective 
clusters, which can be immediately identified by us- 
ing traditional clustering methods (e.g. [3Q|). Observe 
that the nodes appearing at the borders of each of the 
three clusters in Figure 2] correspond precisely to those 
nodes implementing the intercommunity connections (see 
also 23]). 

Figure [5] depicts the clustering structure obtained 
for network Net2. Again, each of the communities 
was clearly mapped into respective clusters in the two- 
dimensional PCA projected space. Again, the bordering 
nodes in each cluster can be found to correspond to the 
interface nodes between communities in the original net- 
work. It is interesting to observe that, compared to the 
previous example, the larger number of communities and 
nodes in this network tended to imply a more cluttered 
distribution, especially at the interface between the red 
and magenta communities. Substantially more separated 
clusters have been observed in three-dimensional PCA 
projected spaces. 

The distribution of nodes obtained for the C. elegans 
network by two-dimensional PCA projection is shown in 
Figure [51 A concentration of nodes can be observed at 
the left-hand side of the space, containing the nodes with 
higher numbers (the numbers follow the original assigne- 
ment as in [2^). A community can also be discerned 
at the lower right-hand side of the transformed mea- 
surement space. Because of the large number of nodes 
in this network, it is interesting to consider additional 
dimensions in the PCA projection. The measurement 
space defined by the principal variables peal and pca2 
is shown in Figure [3 This additional projection shows 
that the denser cluster at the left-hand side of Figure [6l 
is actually scattered along the third variable pca3, with 
a more compact cluster of nodes appearing at the upper 
left-hand side of Figure [71 In addition, a small cluster 
involving nodes 136, 146, 148, 149, 234, 235 and 236 is 
now identifiable at the lower left-hand side of Figure \7\ 

Less definite results were obtained in all cases by con- 
sidering the beginning spiking times, and no clear cluster 
structure was observed when other activation of spiking 
measurements (at given instants or averaged) were used. 



IV. CONCLUDING REMARKS 

This work has addressed an important issue related to 
the structure-dynamics paradigm in neuronal and com- 
plex networks research. More specifically, we have inves- 
tigated how communities of neurons in directed complex 
neuronal networks can be identified by considering the 
transient dynamics of beginning activation of nodes. As a 
consequence of the integration period required for reach- 
ing the firing threshold in each integrate-and-fire neuron, 
the activation incoming from the source node tends to 
be trapped inside the respective community, unfolding 
to other portions of the network only after most of the 



FIG. 2: A medium-sized complex network {Net2) containing 4 communities with 20, 37, 22 and 24 nodes each. 



neurons in that community have started spiking. The 
distribution of the activation flushed outside each neuron 
at the spikings, required for the conservation of the acti- 
vation, was also critical for the compartmentalization of 
the activation inside communities. The distinct patterns 
of beginning activation times obtained by placing the ac- 
tivation source at each of the neurons of each community 
were clearly revealed by the optimal statistical method 
of Principal Component Analysis. More specifically, the 
nodes tended to cluster into respective groups, with the 
nodes at the borders of such groups corresponding to 
those nodes implementing the intercommunity connec- 
tion in the original network. In addition to its intrinsic 
value for biological neuronscience, these results also pro- 
vide effective and simple practical means for obtaining 



neuronal communities. 

Several interesting future works are possible. First, 
it would be important to perform a more systematic 
and comprehensive study of the separability of the com- 
munities by considering other types of networks, with 
distinct interconnectivity between communities, among 
other possibilities. Also interesting is to use hierarchical 
clustering methods (e.g. [3i[Sl33|) in order to obtain 
a hierarchical organization of the neuronal communities, 
as well as investigating how such hierarchies (e.g. [29]) 
are organized with respect to time. As the suggested 
method can be immediately extended to identification 
in other types of networks, including non-directed struc- 
tures, it would be interesting to compare this method 
with other more traditional approaches not involving 
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(a) (b) (c) 

FIG. 3: The activograms and spikegrams, as well as the respective beginning activation and beginning spiking times, are shown 
with respect to the situations where the activation source corresponded to nodes 3 (a), 9 (b) and 16 (c). The beginning time 
diagrams show in black the time instants preceding the first activation or spiking of each neuron. For instance, in the beginning 
spiking times diagram in (a), neuron 5 started spiking at the 8th time step from the initiation of the external activation arriving 
at node 3. 



thresholds. Because abrupt beginning of spiking has been 
observed 17[ for several types of complex networks, it 
would be also interesting to search for possible phase 
transitions of activation inside each community, which 
could be ultimately responsible for the activation trap- 
ping inside each neuronal community during the tran- 
sient activation period. 

All in all, the findings and perspectives reported in 
this article have supported the fact that investigations 



of transient non-linear dynamics are specially promi sing 
and useful in the study of complex systems (see also |17l . 
|3ll,[33,[3l,|3J]). 
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FIG. 5: The PCA projection of the patterns of beginning activation times obtained for Net2. Each of the four original 
communities can be clearly identified from the respective clusters in this scatterplot, with the nodes at the borders of the 
clusters corresponding to the nodes at the borders of the original communities. 



8 
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FIG. 6: The distribution of nodes obtained for the C. elegans network considering the two principal PCA variables peal and 
pca2. 
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PCA projection for C_ elegans 
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FIG. 7: The distribution of nodes obtained for the C. elegans network considering the first and third principal PCA variables 
peal and pca3. 



